Multimodal expression in virtual humans

Expression of Emotions in Virtual Humans Using Lights, Shadows, Composition and Filters

Artists use words, lines, shapes, color, sound and their bodies to express emotions. Virtual humans use postures, gestures, face and voice to express emotions. Why are they limiting themselves to the body? The digital medium affords the expression of emotions using lights, camera, sound and the pixels in the screen itself. Thus, leveraging on accumulated knowledge from the arts, this work propo...

Behavior Generation for Interpersonal Coordination with Virtual Humans: on Specifying, Scheduling and Realizing Multimodal Virtual Human Behavior

Towards Sociable Virtual Humans: Multimodal Recognition of Human Input and Behavior

—One of the biggest obstacles for constructing effective sociable virtual humans lies in the failure of machines to recognize the desires, feelings and intentions of the human user. Virtual humans lack the ability to fully understand and decode the communication signals human users emit when communicating with each other. This article describes our research in overcoming this problem by develop...

Behavior Generation for Interpersonal Coordination with Virtual Humans on Specifying, Scheduling and Realizing Multimodal Virtual Human Behavior Herwin

A Multimodal End-of-Turn Prediction Model: Learning from Parasocial Consensus Sampling

Virtual humans, with realistic behaviors and increasingly humanlike social skills, evoke in users a range of social behaviors normally only seen in human face-to-face interactions. One of the key challenges in creating such virtual humans is giving them human-like conversational skills. Traditional conversational virtual humans usually make turn-taking decisions depending on explicit cues, such...